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6.1 Introduction 

What is the effect of measurement delay on Ott, Grebogi, and Yorke (OGY) chaos con- 
trol? Which possibilities exists for improved control? These questions are addressed 
within this chapter, and the OGY control case is considered as well as a related con- 
trol scheme, difference control; both together form the two main Poincare-based chaos 
control schemes, where the control amplitude is computed once during the orbit after 
crossing the Poincare section. 

If the stabilization of unstable periodic orbits or fixed points by the method given 
by Ott, Grebogi, Yorke ll23l and Hubler ifTSl can only be based on a measurement 
delayed by r orbit lengths, resulting in a control loop latency, the performance of 
unmodified OGY control is expected to decay. For experimental considerations, it 
is desired to know the range of stability with minimal knowledge of the system. In 
section 16.31 the area of stability is investigated both for OGY control and for differ- 
ence control, yielding a delay-dependent maximal Lyapunov number beyond which 
control fails. Sections [6.3.41 to [6.4.31 address the question how the control of delayed 
measured chaotic systems can be improved, i.e., what extensions must be considered 
if one wants to stabilize fixed points with a higher Lyapunov number. Fortunately, 
the limitation can be overcome most elegantly by linear control methods that employ 
memory terms, as linear predictive logging control (Sec. l6.4.T[) and memory difference 
control (Sec. 16.4.31) . In both cases, one is equipped with an explicit deadbeat control 
scheme that allows, within linear approximation, to perform control without principal 
limitations in delay time, dimension, and Ljapunov numbers. 

6.1.1 The delay problem - time-discrete case 

For fixed point stabilization in time-continuous control, the issue of delay has been 
investigated widely in control theory, dating back at least to the Smith predictor 1311 . 
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This approach mimics the, yet unknown, actual system state by a linear prediction 
based on the last measurement. Its time-discrete counterparts discussed in this chapter 
allow to place all eigenvalues of the associated linear dynamics to zero, and always 
ensure stability. The (time-continuous) Smith predictor with its infinite-dimensional 
initial condition had to be refined [|24l[T2| . giving rise to the recently active fields of 
model predictive control [3J. For fixed point stabilization, an extension of permissible 
latency has been found for a modified proportional-plus -derivative controller [28 J. 

Delay is also a generic problem in the control of chaotic systems. The effective de- 
lay time r in any feedback loop is the sum of at least three delay times, the duration of 
measurement, the time needed to compute the appropriate control amplitude, and the 
response time of the system to the applied control. The latter effect appears especially 
when the applied control additionally has to propagate through the system. These re- 
sponse time may extend to one or more cycle lengths ETI . If one wants to stabilize 
the dynamics of a chaotic system onto an unstable periodic orbit, one is in a special 
situation. In principle, a proper engineering approach could be to use the concept 
of sliding mode control [lOJ, i.e. to use a co-moving coordinate system and perform 
suitable control methods within it. However, this requires quite accurate knowledge of 
whole trajectory and stable manifold, with respective numerical or experimental costs. 

Therefore direct approaches have been developed by explicitely taking into ac- 
count either a Poincare surface of section [23| or the explicit periodic orbit length 
[|26l . This field of controlling chaos, or stabilization of chaotic systems, by small 
perturbations, in system variables [fT5l or control parameters [23], has developed to a 
widely discussed topic with applications in a broad area from technical to biological 
systems. Especially in fast systems H29l l2l or for slow drift in parameters [|4l|22l|, dif- 
ference control methods have been successful, namely the time-continuous Pyragas 
scheme [26 J , ETDAS [29,| . and time-discrete difference control [IJ. 

Like for the control method itself, the discussion of the measurement delay prob- 
lem in chaos control has to take into account the special issues of the situation: In 
classical control applications one always tries to keep the control loop latency as short 
as possible. In chaotic systems however, one wants to control a fixed point of the 
Poincare iteration and thus has to wait until the next crossing of the Poincare surface 
of section, where the system again is in vicinity of that fixed point. 

The stability theory and the delay influence for time-continuous chaos control 
schemes has been studied extensively |[T7l [T9l [TTl [TSl [T4|| . and an improvement of 
control by periodic modulation has been proposed in EOl . For measurement delays 
that extend to a full period, however no extension of the time-continuous Pyragas 
scheme is available. 

This chapter discusses the major Poincare-based control schemes OGY control 
[|23l and difference feedback (T\ in the presence of time delay, and addresses the ques- 
tion what strategies can be used to overcome the limitations due to the delay [[8l. 
We show how the measurement delay problem can be solved systematically for OGY 
control and difference control by rhythmic control and memory methods and give 
constructive direct and elegant formulas for the deadbeat control in the time-discrete 
Poincare iteration. While the predictive control method LPLC presented below for 
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OGY control has a direct correspondence to the Smith predictor and thus can be re- 
viewed as its somehow straightforward implementation within the unstable subspace 
of the Poincare iteration, this prediction approach does not guarantee a stable con- 
troller for difference control. However, within a class of feedback schemes linear in 
system parameters and system variable, there is always a unique scheme where all 
eigenvalues are zero, i. e. the MDC scheme presented below. The method can be ap- 
plied also for more than one positive Ljapunov exponent, and shows, within validity of 
the linearization in vicinity of the orbit, to be free of principal limitations in Ljapunov 
exponents or delay time. For zero delay (but the inherent period one delay of differ- 
ence control), MDC has been demonstrated experimentally for a chaotic electronic 
circuit flU and a thermionic plasma discharge diode [22], with excellent agreement, 
both of stability areas and transient Ljapunov exponents, to the theory presented here. 
This chapter is organized as follows. After introducing the notation within a recall of 
OGY control, we give a brief summary what limitations occur for unmodified OGY 
control; details can be found in [8J. From Section [6. 3. 61 we introduce different mem- 
ory methods to improve control, of which the LPLC approach appears to be superior 
as it allows stabilization of arbitrary fixed points for any given delay. The stabilization 
of unknown fixed points is discussed in Section 16.4.31 where we present a memory 
method (MDC) that again allows stabilization of arbitrary unstable fixed points. For 
all systems with only one instable Lyapunov number, the iterated dynamics can be 
transformed on an eigensystem which reduces to the one-dimensional case, and the 
generalization to the case of higher-dimensional subspaces is straightforward BH. 

6.1.2 Experimental setups with delay 

Before discussing the time-discrete reduced dynamics in the Poincare iteration, it 
should be clarified how this relates to an experimental control situation. On a first 
glance, the time-discrete viewpoint seems to correspond only to a case where the de- 
lay (plus waiting time to the next Poincare section) exactly matches the orbit length, 
or a multiple of it. Generically, in the experiment one experiences a non-matching 
delay. Application of all control methods discussed here requires to introduce an ad- 
ditional delay, usually by waiting for the next Poincare crossing, so that measurement 
and control are applied without phase shift at the same position of the orbit. In this 
case the next Poincare crossing position xt+i is a function of the values of x and r at a 
finite number of previous Poincare crossings only, i. e. it does not depend on interme- 
diate positions. Therefore the (a priori infinite-dimensional) delay system reduces to a 
finite-dimensional iterated map. If the delay (plus the time of the waiting mechanism 
to the next Poincare crossing) does not match the orbit length, the control schemes 
may perform less efficient. Even for larger deviations from the orbit, the time between 
the Poincare crossings will vary only marginally, thus a control amplitude should be 
available in time. In practical situations therefore the delay should not exceed the orbit 
length minus the variance of the orbit length that appears in the respective system and 
control setup. 

In a formal sense, the Poincare approach ensures robustness with respect to uncer- 
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tainties in the orbit length, as it always ensures a synchronized reset of both trajec- 
tories and control. Between the Poincare crossings the control parameter is constant, 
the system is independent of everything in advance of the last Poincare crossing. It is 
solely determined by the differential equation (or experimental dynamics). Thus the 
next crossing position is a well defined iterated function of the previous one. This is 
quite in contrast to the situation of a delay-differential equation (as in Pyragas con- 
trol), which has an infinite-dimensional initial condition it 'never gets rid of. One 
may proceed to stability analysis via Floquet theory [fT3ll as investgated for continuous 
IfTTl and impulse length issues in Poincare-based [|51|6ll3 control schemes. Though a 
Poincare crossing detection may be applied as well, the position will depend not only 
on the last crossing, but also on all values of the system variable within a time horizon 
defined by the maximum of the delay length and the (maximal) time difference be- 
tween two Poincare crossings (being non-stroboscopic). Thus the Poincare iteration 
would be a function between two infinite-dynamical spaces. Contrary to a delay dif- 
ferential equation with fixed delay, a major advantage of a Poincare map is to reduce 
the system dynamics to a low-dimensional system; therefore for all control schemes 
discussed here, the additional dimensionality is not a continuous horizon of states, but 
merely a finite set of values that were measured at the previous Poincare crossings. 

6.2 Ott - Grebogi - Yorke (OGY) control 

The method of Ott, Grebogi and Yorke f23) stabilizes unstable fixed points, or unsta- 
ble periodic orbits utilizing a Poincare surface of section, by feedback that is applied 
in vicinity of the fixed point x* of a discrete dynamics xt+i = f{xt, r). For a chaotic 
flow, or corresponding experiment, the system dynamics x = F{x, r) reduces to the 
discrete dynamics between subsequent Poincare sections at to, ^i, • • • ^n- This descrip- 
tion is fundamentally different from a stroboscopic sampling as long as the system is 
not on a periodic orbit, where the sequence of differences (tj — ti^i) would show a 
periodic structure. 

If there is only one positive Ljapunov exponent, we can proceed considering the 
motion in unstable direction only. One can transform on the eigensystem of the Jacobi 
matrix |^ and finds again the equations of the one-dimensional case, i.e. one only 
needs to apply control in the unstable direction (see e.g. [5, 9]). Thus stabiliy analysis 
and control schemes of the one-dimensional case holds also for higher-dimensional 
systems provided there is only one unstable direction. For two or more positive 
Ljapunov exponents on can proceed in a similar fashion (Ullll. 

In OGY control, the control parameter is made time-dependent. The amplitude 
of the feedback = r — tq added to the control parameter tq is proportional by a 
constant e to the distance x — x* from the fixed point, i. e. r = rQ + e{xt — x*), and the 
feedback gain can be determined from a linearization around the fixed point, which 
reads, if we neglect higher order terms, 

f{xt,ro + rt) = f{x*,ro) + {xt-x*)- 
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= fix*,ro) + Xixt- X*) + fin 

= fix*,ro) + iX + fis)-{xt-x*) (6.1) 

The second expression vanishes for e = — A//i, that is, in linear approximation the 
system arrives at the fixed point at the next time step, x^+i = x*. The uncontrolled 
system is assumed to be unstable in the fixed point, i. e. |A| > 1. The system with 
applied control is stable if the absolute value of the eigenvalues of the iterated map is 
smaller than one, 

\xt+i — x*\ = |(A + fie) ■ {xt — x*)\ < \xt — x*\ (6.2) 

Therefore e has to be chosen between (— 1 — A)//i and (+1 — A)//i, and this interval is 
of width 2//i and independent of A, i.e. fixed points with arbitrary A can be stabilized. 
This property however does not survive for delayed measurement. IH, as surveyed 
below. 

6.3 Limitations of unmodified control and simple im- 
proved control schemes 

In this section the limitations of unmodified control are discussed, both for OGY con- 
trol and for difference control. For completeness, rhythmic control and a state space 
memory control are discussed in Sections [6 . 3 . 41 and [6.3.61 

6.3.1 Limitations of unmodified OGY control in presence of delay 

* Figure 6.1: Unmodified 

control in the presence of 
I delay (schematically). 

We want to know what limitations occur if the OGY rule is applied without modi- 
fication. Intuitively, one expects the possibility of unstable behavour of (r + 1) control 
loops that mutually overlap in the course of time (see Figure [6TI) . In OGY control, 
the control parameter is time-dependent, and without loss of generality we assume 
that X* = and that = if no control is applied. First we discuss the simplest 
relevant case r = 1 explicitely. For one time step delay, instead of rt = ext we have 
the proportional feedback rule: 

rt = ext^i. (6.3) 
Using the time-delayed coordinates {xt, Xt^i), the linearized dynamics of the system 
with applied control is given by 



Xt+l 
Xt 
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OGY control 



The eigenvalues of 



1 



are given by ai 2 = ^ ± + efi. Control can be 



achieved with e being in an interval ] — — A)//i[ with the width {2 — \)/ ji (see 

Figure lOl) . 

In contrast to the not-delayed case, we have a requirement A < 2 for the Lyapunov 
number: Direct application of the OGY method fails for systems with a Lyapunov 
number of 2 and higher JH [8l. This limitation is caused by the additional degree of 
freedom introduced in the system due to the time delay. 

Now we consider the general case. If the system is measured delayed by r steps, 
Tt = sxt-T, we can write the dynamics in time-delayed coordinates {xt, Xt-i, Xt-2, ■ ■ - Xt- 
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The characteristic polynomial is given by (we define rescaled coordinates a := a/ A 
and£ = e^u/A^+i) 



or 



= P{ol) = (a — X)d' — Ell 
= P{a] = {a-\W -e. 



(6.5) 



Fig. 16.31 shows the maximum of the absolute value of the eigenvalues. In rescaled 
coordinates a = 1/A corresponds to a control interval ^^^(t, A). For 
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Figure 6.3: Control intervals for several time delays r = . . . 5: The plots show the 
maximal absolute value of the eigenvalues as a function of the rescaled control gain 
e. Values of |a| = 1/A correspond to |a| = 1 in (16.51) without rescaling, so one can 
obtain the range e+[ for which control is successfully achieved. 

the control interval vanishes, and for A > Amax(T) no control is possible flUdl. If we 
look at the Lyapunov exponent A := In A instead of the Lyapunov number, we find 
with In X < (x — 1) the inequality 

Amax ■ r < 1. (6.7) 

Therefore, delay time and Lyapunov exponent limit each other if the system is to be 
controlled. This is consistent with the loss of knowledge in the system by exponential 
separation of trajectories. 

6.3.2 Stability diagrams derived by the Jury criterion 

For small r one can derive easily the borders of the stability area with help of the Jury 
criterion f5','8|. The Jury criterion [il6il gives a sufficient and necessary condition that 
all roots of a given polynomial are of modulus smaller than unity. Given a polynomial 

P{x) = a^x" + ttn-ix'^'^^ H h aix + Oq, one applies the iterative Jury table scheme: 

giving an and coefficients fln-i- • -Oo for the next iteration. The Jury criterion states 
that the eigenvalues are of modulus smaller than unity if and only if Vi<j<„|aj| < 1. 
The criterion gives 2n (usually partly redundant) inequalities that define hypersurfaces 
in coefficient space. The complete set of lines is shown in Figure 16.41 for r = 4 to 
illustrate the redundancy of the inequalities generated by the Jury table. For r = 1, 
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Figure 6.5: Stability areas for r = 1, 2, 3, 4, combined. Only for |A| > 1 control is 
necessary (dashed line), and the stability area (shaded for r — A) extends to | Amaxl = 
2, 3/2, 4/3, 5/4. Note that still both positive and negative A can be controlled. The 
abscissa —fxe{sgnXY^^^^ takes into account that for odd r a negative /le is required, 
independent of the sign of A. 
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the Jury coefficients are given by ai = —A/ (1 + fie) and a2 = —fie. Control is only 
necessary for | A| > 1, and by folding the relevant stability area into the same quadrant 
one obtains Fig. 16.51 showing how Amax decreases for increasing r. 



6.3.3 Stabilizing unknown fixed points: Limitiations of unmodi- 
fied difference control 

As the OGY approach discussed above requires the knowledge of the position of the 
fixed point, one may wish to stabilize purely by feeding back differences of the sys- 
tem variable at different times. This becomes relevant in the case of parameter drifts 
which often can occur in experimental situations. A time-continuous strategy 
r{t) = e{x{t) — x{t — Td)) has been introduced by Pyragas [|26l . where r{t) is up- 
dated continuously and matches the period of the unstable periodic orbit. The time- 
discrete counterpart (i.e. control amplitudes are calculated every Poincare section) is 
the difference control scheme [1]: For control without delay, a simple difference con- 
trol strategy 

rt = e{xt-r - xt-r-i) (6.8) 
is possible for e/x = —A/3, and eigenvalues of modulus smaller than unity of the ma- 
trix ^ ^ + 0^ ^ obtained only for —3 < A < +1, so this method stabilizes 

only for oscillatory repulsive fixed points with —3 < A < —1 [IJ, see the r = case 
in Figure [6!6l) . 

We can proceed in a similar fashion as for OGY control. In the presence of r steps 
delay the linearized dynamics of difference control is given by 

-efi \ ( X, \ 
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in delayed coordinates (xj, Xt_i, . . . Xt_r-i), and the characteristic polynomial is given 
by 







a — A)a; + (1 — a)efi. 



(6.9) 



As we have to use Xt-r-i in addition to xt-r, the system is of dimension r + 2, and 
the lower bound of Lyapunov numbers that can be controlled are found to be 
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3 + 2r 
'l + 2r 
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r+1/2^ 



(6.10) 
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and the asymptotic control amplitude at this point is 

(-1)" 

The stability area in the {fxe, A) plane is bounded by the lines = ±1 where 
a-i are the coefficients given by the Jury criterion [,16,1 (see Figure [6^ . For r = 0, 
the Jury coefficients are ai = and 0:2 = £A*- For r = 1 to r = 3, the Jury 

coefficients are given in [[8||. 




Figure 6.6: Difference feedback for r = 0, 1, 2, 3: Stability borders derived by the 
Jury criterion [|5l|8l. The stability diagram of the non-delayed case r = has already 
been given in [I]. From A = — 1 (dashed line) to A = +1 the system ist stable without 
control. For each r, control is effective only within the respective area (shaded for 
r = 3). 

The controllable range is smaller than for the unmodified OGY method, and is re- 
stricted to oscillatory repulsive fixed points with Ainf < A < — 1. Thus, delay severely 
reduces the number of controllable fixed points, and one has to develop special control 
strategies for the control of delayed measured systems. A striking observation is that 
inserting r + ^ for r in eq. (16.61) exactly leads to the expression in eq. (16.101) which 
reflects the fact that the difference feedback control can be interpreted as a discrete 
first derivative, taken at time t — (r + i). Thus the controllability relation (16.71) holds 
again. 

As A ^ Ms implying a natural time scale (that of exponential separation) of an orbit, 
it is quite natural that control becomes limited by a border proportional to a prod- 
uct of A and a feedback delay time. Already without the additional difficulty of a 
measurement delay this is expected to appear for any control scheme that itself is 
using time-delayed feedback: E.g. the extensions of time-discrete control schemes 
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discussed in [jSOl with an inherent Lyapunov number limitation due to memory terms, 
and the experimentally widely applied time-continuous schemes Pyragas and ETDAS 
[fTTl [T9l nn . Here Pyragas control has the Lyapunov exponent limitation Arp < 2 
together with the requirement of the Floquet multiplier of the uncontrolled orbit hav- 
ing an imaginary part of vr, meaning that deviations from the orbit after one period 
experience to be flipped around the orbit by that angle, which is quite the generic case 
ifTSl . This nicely corresponds with the requirement of a negative Lyapunov number 
that appears in difference control. A positive Lyapunov number in the time-discrete 
picture corresponds to a zero flip of the time-continuous orbit, and is consistently 
uncontrollable in both schemes. 

Recently, the influence of a control loop latency has also been studied for con- 
tinuous time-delayed feedback [|T8l by Floquet analysis, obtaining a critical value 
for the measurement delay r, that corresponds to a maximal Lyapunov exponent 
log |Ainf I = Arp = ' where Tp is the orbit length and matched feedback de- 

lay. By the log inequality that again translates (for small Ljapunov exponents) to 
our result for the time-discrete difference control. An exact coincidence could not 
be expected, as in Pyragas control the feedback difference is computed continuously 
sliding with the motion along the orbit, where in difference control it is evaluated 
within each Poincare section. For the ETDAS scheme with latency, a detailed analysis 
is performed in [14J, showing that the range of stability can be extended compared 
to the Pyragas scheme. Although the time-continuous case (as an a priori infinite- 
dimensional delay-differential system) could exhibit much more complex behaviour, 
it is, however astonishing that for all three methods, OGY, difference, and Pyragas 
control, the influence of measurement delay mainly results in the same limitation of 
the controllable Lyapunov number. 

6.3.4 Rhythmic control schemes: Rhythmic OGY control 

Figure 6.7: Rhythmic control 
(schematically). Keeping control 
quiet for r intermediate time steps 
avoids the additional degrees of 
freedom. However, the effec- 
tive Lyapunov number to be con- 
trolled then is raised to A"^"*"^. 

As pointed out for difference control in the case r = in 0], one can eliminate 
the additional degrees of freedom caused by the delay term. One can restrict himself 
to apply control rhythmically only every r + 1 timesteps (r + 2 for difference control), 
and then leave the system uncontrolled for the remaining timesteps (see Fig. 16.71) . 
Then e = 6{t) 
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appears to be time-dependent with 



e{t mod r) = {eq, 0, . . . , 0) 



(6.12) 



and, after (r + 1) iterations of (|6.4I) . we again have a matrix as in (|6.4I) . but with A"^ 
instead of A. Equivalently, we can write 



What we have done here, is: controlling the (r + l)-fold iterate of the original sys- 
tem. This appears to be formally elegant, but leads to practically uncontrollable high 
effective Lyapunov numbers A^+^ for both large A and large r. 

Even if the rhythmic control method is of striking simplicity, it remains unsatis- 
fying that control is kept quiet, or inactive, for r time steps. Even if the state of the 
system x is known delayed by r, one knows (in principle) the values of xt for t < t, 
and one could (in principle) store the values Srt-r ■ ■ - Srt of the control amplitudes 
applied to the system. This can be done, depending on the timescale, by analog or 
digital delay lines, or by storing the values in a computer or signal processor (ob- 
serve that there are some intermediate frequency ranges where an experimental setup 
is difficult). 

Both methods, rhythmic control and simple feedback control in every time step, 
have their disadvantages: For rhythmic control it is necessary to use rather large con- 
trol amplitudes, in average A^/r, and noise sums up to an amplitude increased by 
factor ^/T. For simple feedback control the dimension of the system is increased and 
the maximal controllable Lyapunov number is bounded by (|6.6I) . One might wonder 
if there are control strategies that avoid these limitations. This has necessarily to be 
done by applying control in each time step, but with using knowledge what control 
has been applied between the last measured time step t — r and t. This concept can be 
implemented in at least two ways, by storing previous values of Xt (Section [6.3.61) or 
previous values of 6rt (LPLC, Section |6Al] and MDC, Section |6A3]). 

6.3.5 Rhythmic difference control 

To enlarge the range of controllable A, one again has the possibility to reduce the 
dimension of the control process in linear approximation to one by applying control 
every r + 2 time steps. 



y+1 



Xt + eofiXt. 



(6.13) 



Xt+l 



XXt + He{Xt-r - Xt-r-l) 

(A^^^ + iieX — fie)xt-r-i 



(6.14) 



and the goal Xt+i = can be fulfilled by 



(6.15) 
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One has to choose fie between fie± = — to achieve control as shown in Fig. l6.8[ 

The case r = has already been discussed in |[T1. With rhythmic control, there is 
no range limit for A, and even fixed points with positive A can be stabilized by this 
method. 





Figure 6.8: Stability area of rhythmic difference control for r = 0, 1,2, 3, 4, 5. 

When using differences for periodic feedback, one still has the problem that the con- 
trol gain increases by A"^, and noise sums up for r + 1 time steps before the next control 
signal is applied. Additionally, now there is a singularity for A = +1 in the "optimal" 
control gain given by (16.141 ). This concerns fixed points where differences Xt — Xt^i 
when escaping from the fixed point are naturally small due to a A near to +1. 

Here one has to decide between using a large control gain (but magnifying noise 
and finite precision effects) or using a small control gain of order yU£:_(A = +1) = 
r + 1 (but having larger eigenvalues and therefore slow convergence). 

Two other strategies that have been discussed by Socolar and Gauthier Il30ll are 
discretized versions of time-continuous methods. Control between A = — (3+-R)/(l — 
i?) and A = -1 is possible with discrete-ETDAS {R < 1) n = e J2T=o R'' i^t-k - 
xt-k-i) and control between A = — (A^ + 1) and A = — 1 is acheived with discrete- 
NTDAS (let A" be a positive integer) which is defined by rt = e (xt — ^ Ylk=o ^t-k^ ■ 
Both methods can be considered to be of advantage even in time-discrete control in 
the Poincare section, e.g. if the number of adjustable parameters has to be kept small. 
Whereas these methods are mainly applied in time-continuous control, especially in 
analogue or optical experiments, for time-discrete control the MDC strategy described 
below allows to overcome the Lyapunov number limitations. 
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6.3.6 A simple memory control scheme: Using state space memory 




Figure 6.9: A state space mem- 
ory control (schematically). For 
electronic or optic analogue cir- 
cuits, the idea to use additional 
delay lines is appealing, though 
the applicability is restricted to 
the r = 1 OGY case (which will 
cover most experiments). 



We extend the single delay line by several artificial delay lines (see Fig. 16.91) . each 
with an externally tuneable control gain coefficient [151 HI: 



rt — EiXt^l + S2Xt-2 + . . . + Sn+lXt-n-l 

For n steps memory (and one step delay) the control matrix is 



(6.16) 



(xt+l\ fx El 

1 
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/ 



(6.17) 



with the characteristic polynomial (a — A)q;"+^ + Ya=i £i<y"'~\ We can choose ai = 
0L2 = ... an+2 = — A/(n + 2) and evaluate optimal values for all £i by comparing 
with the coefficients of the product nr=i^('^ — This method allows control up to 
Amax = 2 + n, thus arbitrary A can be controlled if a memory length of > A — 2 and 
the optimal coefficents Si are used. 

For more than one step delay, one has the situation Ei = 0, . . . , Sr-i = 0. This 
prohibits the 'trivial pole placement' given above, (choosing all ctj to the same value) 
and therefore reduces the maximal controllable A and no general scheme for optimal 
selection of the Si applies. One can alternatively use the LPLC method described 
below, which provides an optimal control scheme. One could wonder why to consider 
the previous state memory scheme at all when it does not allow to make all eigenvalues 
zero in any case. First, the case of up to one orbit delay and moderately small A already 
covers many low-period orbits. Second, there may be experimental setups where the 
feedback of previous states through additional delay elements and an analog circuit is 
experimentally more feasible than feedback of past control amplitudes. 
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6.4 Optimal Improved Control schemes 

6.4.1 Linear predictive logging control (LPLC) 

If it is possible to store the previously applied control amplitudes rj, rt_i, . . ., then one 
can predict the actual state xt of the system using the linear approximation around the 
fixed point (see Fig. 16.101 ). That is, from the last measured value Xt-r and the control 
amplitudes we compute estimated values iteratively by 

yt~i+i = Axt_i + firt-i (6.18) 

leading to a predicted value yt of the actual system state. Then the original OGY for- 
mula can be applied, i. e. = —X/fiyt. In this method the gain parameters are again 
linear in xt-r and all {r^/} with t — t < t' < t, and the optimal gain parameters can 
be expressed in terms of A and ji. 

Figure 6.10: Linear predictive 
logging control (schematically). 
In LPLC, all intermediately ap- 
plied control amplitudes are em- 
ployed for a linear prediction. 
A corresponding scheme (MDC, 
Section 16.4.31) exists also for dif- 
ference control. 

In contrast to the memory method presented in the previous subsection, the LPLC 
method directs the system (in linear approximation) in one time step onto the fixed 
point. However, when this control algorithm is switched on, one has no control applied 
between t — r and t — 1, so the trajectory has to be fairly near to the orbit (in an interval 
with a length of order (5/ A"^, where 5 is the interval halfwidth where control is switched 
on). Therefore the time one has to wait until the control can be successfully activated 
is of order A^^^ larger than in the case of undelayed control. 

The LPLC method can also be derived as a general linear feedback in the last mea- 
sured system state and all applied control amplitudes since the system was measured 
- by choosing the feedback gain parameters in a way that the linearized system has all 
eigenvalues zero. The linear ansatz 

rt = e- xt-r-i + Vin-i + ■■■ Vrn-T (6.19) 

leads to the dynamics in combined delayed coordinates 

{xt, Xt-i, . . . , Xt-T, r t-i, . . . , r t-r) 
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giving the characteristic polynomial 
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f Xt \ 

Xt^l 



1 0/ 



Xt-T 

n-i 



\rt-r) 



... + a^(A ■ r]r-i - r]r) + (A ■ - 5)). 



(6.20) 



-A*. A generalization 



All eigenvalues can be set to zero using e = — A''+^ and r/j : 
to more than one positive Lyapunov exponent is given in |[9l. 

6.4.2 Nonlinear predictive logging control 

One can also consider a nonlinear predictive logging control (NLPLC) strategy BUl 
as the straightforward extension to the LPLC method for nonlinear prediction. If the 
system has a delay of several time steps, the interval where control is achieved be- 
comes too small. However, if it is possible to extract the first nonlinearities from the 
time series, prediction (and control) can be fundamentally improved. In NLPLC, the 
behaviour of the system is predicted each time step by a truncated Taylor series 



2 ' ' 2 

using applied control amplitudes {rt} for each time step. This equation has to be 
solved for using Xt+i = 0. A similar nonlinear prediction method has been de- 
scribed by Petrov and Showalter [1251 . They approximate the Xt+i{xt, rt) surface di- 
rectly from the time series and use it to direct the system to any desired point. Both 
Taylor approximation or Petrov and Showalter method can be used here iteratively, 
provided one knows the delay length. Both approaches could be regarded as a nonlin- 
ear method of model predictive control |l3l, applied to the Poincare iteration dynamics. 

From a practical point of view, it has to be mentioned that one has to know the fixed 
point X* more accurate than in the linear case. Otherwise one experiences a smaller 
range of stability and additionally a permanent nonvanishing control amplitude will 
remain. This may be of disadvantage especially if the fixed point drifts in time (e.g. by 
other external parameters such as temperature) or if the time series used to determine 
the parameters is too short. 
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6.4.3 Stabilization of unknown fixed points: Memory difference 
control (MDC) 

As all methods mentioned above require the knowledge of the position of the fixed 
point, one may wish to stabilize purely by feeding back differences of the system 
variable at different times. Without delay, difference feedback can be used success- 
fully for sji = —A/3, and eigenvalues of modulus smaller than unity of the matrix 

^ A + e/i ^ are obtained only for —3 < A < +1, so this method stabilizes only 

for oscillatory repulsive fixed points with — 3 < A < — 1 [[Tl. 

Due to the inherent additional period one delay of difference control and MDC, 
the r period delay case of MDC corresponds, in terms of the number of degrees of 
freedom, to the r + 1 period delay case of LPLC. 

One may wish to generalize the linear predictive feedback to difference feedback. 
Here, caution is advised. In contrary to the LPLC case, the reconstruction of the 
state Xt^r from differences Xt-r-i — ^^t-r-i-i and applied control amplitudes rt^j 
is no longer unique. As a consequence, there are infinitely many ways to compute 
an estimate for the present state of the system, but only a subset of these leads to a 
controller design ensuring convergence to the fixed point. Among these there exists 
an optimal every- step control for difference feedback with minimal eigenvalues and 
in this sense optimal stability. 

To derive the feedback rule for MDC JHIHlll, we directly make the linear ansatz 



rt = e- {xt_r-i - xt^r-i-i) + Virt-1 + ■ 
with the dynamics in combined delayed coordinates 
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giving the characteristic polynomial 







-a"(a"+^ + a"(-A-r/i) 
+a^-\\-rii -ri2) + a^'^ 
... + a^{\ ■ r]r-2 - Vt-i) 



(A ■ r/2 - 773) 



+a (A ■ r]r-i - r]^ - e) + {X 



Vr + e)). 



(6.21) 



All eigenvalues can be set to zero using e = — A'^+^/(A — 1), rj^. = / (A — 1) and 
rfi = —A* for 1 < i < T — 1. This defines the MDC method. For more than one 
positive Lyapunov exponent see [El HI. 



Delayed measurement is a generic problem that can appear in controlling chaos ex- 
periments. In some situations it may be technically impossible to extend the control 
method, then one wants to know the stability borders with minimal knowledge of the 
system. 

We have shown that both OGY control and difference control cannot control orbits 
with an arbitrary Lyapunov number if there is only delayed knowledge of the system. 
The maximal Lyapunov number up to which an instable orbit can be controlled is 
given by 1 + ^ for OGY control and 1 + Tif^ for difference control. For small r the 
stability borders can be derived by the Jury criterion, so that the range of values for the 
control gain e can be determined from the knowledge of the Taylor coefficients A and 
fi. If one wants to overcome these limitations, one has to modify the control strategy. 

We have presented methods to improve Poincare-section based chaos control for 
delayed measurement. For both classes of algorithms, OGY control and difference 
control, delay affects control, and improved control strategies have to be applied. Im- 
proved strategies contain one of the following principle ideas: Rhythmic control, con- 
trol with memory for previous states, or control with memory for previously applied 
control amplitudes. In special cases the unmodified control, previous state memory 
control, or rhythmic control methods could be considered, especially when experi- 
mental conditions restrict the possibilities of designing the control strategy. 

In general, the LPLC and MDC strategies allow a so-called deadbeat control with 
all eigenvalues zero; and they are in this sense optimal control methods. All parame- 
ters needed for controller design can be calculated from linearization parameters that 
can be fitted directly from experimental data. This approach has also been sucessfuUy 
applied in an electronic flU and plasma [|22l experiment. 
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